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Abstract 

In this paper we consider a linear system structured into physically coupled subsystems 
and propose a decentralized control scheme capable to guarantee asymptotic stability and 
satisfaction of constraints on system inputs and states. The design procedure is totally de- 
centralized, since the synthesis of a local controller uses only information on a subsystem and 
its neighbors, i.e. subsystems coupled to it. We first derive tests for checking if a subsystem 
can be plugged into (or unplugged from) an existing plant without spoiling overall stability 
and constraint satisfaction. When this is possible, we show how to automatize the design of 
local controllers so that it can be carried out in parallel by smart actuators equipped with 
computational resources and capable to exchange information with neighboring subsystems. 
In particular, local controllers exploit tube-based Model Predictive Control (MPC) in order 
to guarantee robustness with respect to physical coupling among subsystems. Finally, an 
application of the proposed control design procedure to frequency control in power networks 
is presented. 
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1 Introduction 



Decentralized regulators have been studied since the 70's as a viable solution to the control of 
large-scale systems composed by several physically coupled subsystems [BL88[ ILun92| . Compared 
to centralized schemes, decentralized control structures offer several advantages such as parallel 
computation of control variables, local transmission of information between each subsystem and 
the corresponding regulator and higher reliability in presence of controller faults. The problem of 
guaranteeing stability and suitable performance levels for decentralized control systems has been 
addressed in the 70 's and 80 's mainly for unconstrained systems |WD73[ rLun92| . Similar remarks 
apply to distributed control (also known as overlapping decentralized control), where controllers 
can exchange pieces of information through a communication network (see, e.g. |LA08| . and 
references therein). 

Decentralized and distributed control schemes for constrained systems have been proposed only 
much more recently in the context of Model Predictive Control (MPC) |C JKT02[ |KBB06[ iRMSOTl 
IFSlli IFS121 IRFT121 IRMOQj . These results are particularly appealing because replace large-scale 
optimization problems stemming from centralized MPC with several smaller-scale problems that 
can be solved in parallel using computational resources collocated with sensors. While the main 
focus of decentralized and distributed control is on limiting the computational burden and commu- 
nication cost associated to real-time copcrations of the control system, attention has also been paid 
to the complexity of the controller design procedure. In this respect, decentralized and distributed 
controllers can be designed either in a centralized fashion, i.e. relying on the knowledge of the 
collective model, or in a decentralized fashion, i.e. not requiring the knowledge of the collective 
model |BL881 lLun92| . However, decentralized design does not prevent from using collective quan- 
tities, based on pieces of information from all subsystems. An example are decentralized control 
schemes that rely on vector Lyapunov functions for assessing the stability of the closed-loop sys- 
tem [Lun92j and hence require stability analysis of an M-th order system where M is the number 
of subsystems. 

In this paper we move one step further and propose decentralized MPC (DeMPC) schemes 
with Plug-and-Play (P&P) capabilities. Similarly to jSto09j . P&P means that 

(i) the design of a single controller involves at most information about the subsystem under 
control and its neighbors, i.e. no step of the design procedure involves collective quantities; 

(ii) when a subsystem joins/leaves an existing plant there is a procedure for 

(a) assessing if the operation does not spoil stability and constraint satisfaction for the overall 
plant; 

(b) automatically retuning at most the controllers of the subsystem and its successors, i.e. 
subsystems influenced by it. 

P&P controllers are attractive for the following reasons. First, the complexity of designing a 
controller for a given subsystem scales with the number of neighboring subsystem only. Second, 
P&P cases the revamping of control systems by enabling the replacement of actuators with limited 
interaction of human operators. It is well known that, for general interconnection topologies, 
requirement ([!]) above implies the design of regulators for each subsystem that are robust to the 
coupling with neighboring subsystems jLun92j . Our design procedure is no exception and we will 
exploit tube-based MPC [MSROSj for the design of robust local controllers. While this introduces 
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an unavoidable degree of conservatism, we argue that P&P DeMPC can be successfully applied 
in a number of real world plants where coupling among subsystems is sufficiently weak. As an 
example, we will use P&P DcMPC for designing the Automatic Generation Control (AGC) layer 
for frequency control in a realistic power network and discuss the plugging in and unplugging of 
generators areas. 

The paper is structured as follows. The design of decentralized controllers is introduced in 
Section [2] with a focus on the assumptions needed for guaranteeing asymptotic stability of the 
origin and constraint satisfaction. In Section [3] we discuss how to design the local controllers in 
a distributed fashion and in Section 0] we describe P&P operations. In Section [5] we discuss the 
practical design of the local controllers. In Section IH] we present the application of P&P DcMPC 
to frequency control in a power network and Section [7] is devoted to concluding remarks. 

Notation. We use a : 6 for the set of integers {a, a + 1,...,6}. The column vector with 
s components vi,...,Vs is v The function diag(Gi, . . . , Gg) denotes the block- 

diagonal matrix composed by s block Gi, i G 1 : s. The pseudo- inverse of a matrix A G R™^" is 
denoted with . The symbol © denotes the Minkowski sum of sets, i.e. A — B (BC ii and only if 
A ^ {a : a = b + c, for all G B and c G C}. Moreover, 0-^i G,; = Gi © . . . © G^. The symbols 
In and 0„ denote the column vectors with n elements equal to 1 and 0, respectively. A zonotope 
is a centrally symmetric convex polytopes: given a vector p G M" and a matrix S G R"^™, the 
zonotope X C R" is the set X = {a: | x = p + Ed, \\d\\oo < 1}, with d G M". Moreover, if X is a 
zonotope, its support function in the direction c G M" is given by |KG98) as 

sup c^x = ||S"^c||i. (1) 

The set X C R" is Robust Positively Invariant (RPI) |RM09! for x{t + 1) = f{x{t),w{t)), w{t) G 
W C R" if x{t) G X ^ f{x{t),w{t)) G X, \/w{t) G W. The RPI set X is minimal if every other 
RPI X verifies X C X. The RPI set X((5) is a 5-outcr approximation of the minimal RPI X if 

X G X((5) ^ 3 X G X and o- G Ba-(O) : a; = £ + cr. (2) 

where Bs{v) is the 2-norm open ball of radius S centered in v G R". 



2 Decentralized tube-based MPC of linear systems 

We consider a discrete-time Linear Time-Invariant (LTI) system 

x+ = Ax + Bu (3) 

where x G M" and u G R™ are the state and the input, respectively, at time t and x+ stands for 
x at time t + 1. We will use the notation x(i), u{t) only when necessary. The state is partitioned 
into M state vectors xjj] G K"', i € M = 1 : M such that x = (x^ij, . . . and n = X^ieA^ 

Similarly, the input is partitioned into M vectors G R™' , i & Ai such that u = . . . , u^m]) 
and m = Y.i£M 

We assume the dynamics of the i ~ th subsystem is given by 

: = A^x^i^ + B^u^i^ + w^^ (4) 
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where Aij £ K"^^"^^ i,j £ M, Bt £ ]R"iX™i and Mi is the set of neighbors to subsystem i defined 
as M = {j £ M : A,j ^0,i^ j}. 

According to (jH), the matrix A in ([3]) is decomposed into blocks Aij, i,j £ M. We also define 
Ad — diag(Aii, . . . , Amm) and Ac = A — Ad, i-e. Ad collects the state transition matrices of 
every subsystem and Ac collects coupling terms between subsystems. From Q one also obtains 
B — diag(i?i, . . . , Bm) because submodels ^ are input decoupled. 

In this Section we propose a decentralized controller for (jSj guaranteeing asymptotic stability 
of the origin of the closed-loop system and constraints satisfaction. 

In the spirit of tube-based control |MSR05) , we treat w^^j as a disturbance and equip with 
the controller C[i] given by 

= + Ki{xi{\ - X[{\). (6) 

where Ki £ i £ M and variables and x^i^ will be computed by a local state- feedback 

MPC controller, i.e. there exist functions Ki : W" M™' and r]t : W" — > M"' such that ~ 
Ki(x[i^) and xjj] = r]i{x[q). Note that the controller C^q is completely decentralized, since it depends 
upon quantities of system only. 

Next, we clarify properties of matrices Ki, i £ Ai that are required for the stability of system ^ 
controlled by (jB]). Defining the collective variables x = (a;[i], . . . , X[m]) £ R", v — (w[i], . . . , V[m]) G 
R™ and the matrix K = chag(i^i, . . . , Kai) £ R™^", from (g]) and © one obtains the collective 
model 

x+ (A + BK)x + B(v-Kx). (7) 
The following assumptions will be needed for designing stabilizing controllers C[i] . 
Assumption 1. (i) The matrices Fi — An + BiKi, i £ Ai are Schur. 
(a) The matrix F = A + BK is Schur. 

m 

We discuss now constraints satisfaction. To this purpose, we equip subsystems Ej^j, i £ Ai 
with the constraints X[i] £ Hi, £ Ui, define the sets X = HiGX ^ ^ IlieAi ^« ^^^'^ consider 
the collective constrained system with 

X G X, u e U. (8) 

As in tube-based MPC control |MSR05| . our goal is to compute tightened state constraints X.; C X.; 
and input constraints C Ui guaranteeing that 

X[,]{k)£±„ V[,]{k)£Y,, yt£M (9) 
=^x{k + l) eX, u(fc) eU, 

The next Assumption characterizes the shape of constraints X^, X.^, Ui and Yi, i £ Ai 

Assumption 2. Constraints X^ and X^ are zonotopes given by 

X, = {x[,] £ < l,r £ 1 : n} = {x[^ £ R"'\T^X[,] < 

= {x[,] £ W"\x[,] = E,d„ \\d,\\oo < 1}, 

X, = {x[,] £ M"'|/^,X[,] <k,r£l: h} = {£[,] £ < U,-J 
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(10) 
(11) 



where = {fl^^, ■ ■ ■ , fl^.J ^ rank{F,) = n,, d, e W% e R"'^^'--, /, G R+, = 

{fli, ■ • • , fjf) e M^*''"',, d^ e W"^ and % £ M"'^"^' . 

Constraints Ui and Yi, i G A4 are polytopes containing the origin in their interior, that, without 
loss of generality, are defined as follows 

V, = e M™-|/i^,U[,] < l,r e 1 : r„J = £ R"'|H,^i[,] < l.„J, (12) 

V, = e R""|/i^,W[,] < 1 - r e 1 : r„J = S M'"' |7^,W[,] < i.„^ - Z,J, (13) 
w/iere = {hl^, . . . ,hf,,^J £ r-.x™., g and 1^^ = (/^,_, , . . . , J. 

■ 

From the results in jKG98j . under Assumptions [I]- (|i]) and[2]there exist nonempty RPIs C M"' , 
i e for the dynamics 

z+fi] = (An + BiKi)z[ii + W[i] (14) 

and Wi G Wi = A,;jXj. In particular, for 6i > 0, we denote with Zi((5i) an RPI set that is 

a (5i-outer approximation of the minimal RPI for (fH)) and wiij G W,;. 
For guaranteeing Q, we introduce the following Assumption. 

Assumption 3. There exist Si > and nonempty constraint sets and V^, Vi G verifying 

X,®Z,{S.,) CX, (15) 
V,©i^,Z,(JO CU,. (16) 



Note that, by construction, one has Zi{Si) D Wi and therefore and ([T5|) cannot be verified 
if W, is "too big", i.e. D or KiW^ D 

Under Assumptions [1][31 as in |MSR05) . we set in ^ 

i^i{xii\{t)) = w[i](0|t), 77i(a;[i](t)) = i-[,;](0|t) (17) 

where U[i](0|t) and ^[j] (0|i) are optimal values of variables W[i](0) andi[i](0), respectively, appearing 
in the following MPC-i problem to be solved at time t 

Ni-l 

Pf(xH(t))= min ^ £,(i[,](fc),i,H(fc)) + T//,(iH(7V,)) (18a) 

i;[,j(0:Ar,-l) 

X[,]{t) - X[,]{0) E Z,{S,) (18b) 

x[,^{k + 1) = Aux[^{k) + B,v[^{k) keO:N,-~l (18c) 

£[,;](fc)GX, k€0:N,-l (18d) 

V[^{k)eY^ k&0:N,~~l (18e) 

a;[,](A^,)e% (18f) 

In ([T5)). A^j G N is the prediction horizon, £j(a;[i] (fc), uj^] (fc)) : R"'X'"» — ;> is the stage cost and 
Vf.{x[i]{Ni)) : M"' — !> M+ is the final cost, fulfilling the following assumption. 

Assumption 4. For alii E M., there exist an auxiliary control law K°"^(i;[i]) and a K-oo function 
Bi such that: 
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(i) e^{x[^,u[,]) > BMx[r],U[,])\\), for all x[,] G R"\, U[,] E M"' and £,(0,0) = 0; 
(ii) 'Kf. C Xj is an invariant set for Xj^j = Aux^^ + BiK^"'^{x[i]); 
(ill) Vi[,] gX/,, G V,; 

■ 

We highlight that there are several methods, discussed e.g. in [RM09j . for computing £{{■), 
Vf.{-) and X/. veriiying Assumptions) 

The next Theorem, that is proved in Appendix \^ provides the main results on stability of the 
closed- loop system ([7]) and ([T7)) equipped with constraints (|5]). 

Theorem 1. Let Assumptions{Tj^hold. Define the feasibility region for the MPC-i problem as 

= {s[i] G Xi : (|18p is feasible for X[i]{t) ~ s^jj} 

and the collective feasibility region as X^ = JlieA^ ^i^- 
Then 

(i) ifx{0) G X^, i.e. X[j](0) G Xf for alii G Ai, constraints ^ are fulfilled at all time instants; 

(ii) the origin of the closed-loop system ([7]) and (jl7p is asymptotically stable and X^ is a region 
of attraction. 

m 

In order to design a DeMPC scheme based on MPC-i problems ([T8)) and for which Theorem [T] 
applies, the main problem that still has to be solved is the following one. 

Problem V 

Compute matrices Ki, i G A4i, if they exist, verifying Assumptions [1] and [31 

■ 

In the next Section, we show how to solve Problem T' in a distributed fashion under Assumption 
[2] complemented by the next assumption. 

Assumption 5. Matrices Fi (and hence Ei) in (fTTj) are given for i £ Ai. 

m 

Note that Assumption [5] fixes the shape of set X^, i E Ai leaving the freedom to choose the 
zooming parameters li. Also the shape of each set Yi is fixed and, from Assumption[2J it coincides 
with the shape of Ui while parameters ly. are free. 
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3 Decentralized synthesis of DeMPC 



The next Theorem wiU aUow us to solve Problem V in a distributed fashion. 

Theorem 2. Let Assumptions\^ and\^ hold. For given matrices Ki, i E Ai, verifying Assumption 
if the following conditions are fulfilled 

oo 

(^^=J2J2 ll-^»^My-^)lU < 1, V^ e X (19) 

j£^fi k=o 

then 

(i) Assumption]^ holds, 
(a) For all i G A4, defining 



1 X^jSA^i X]fc=0 I l^iT'-^^'^^^J". 

there is Si > such that 

U = mm Li - > 0. (21) 

Furthermore, choosing li G (0, L^] and the set as in (jlip . the inclusion (|15p holds. 
(Hi) For 5i > verifying (|2ip assume the following condition is fulfilled 

P^iS,)^ max /;_(<50<1 (22) 



with 



Iv, A^i) = sup hi ^KiZi, r G 1 : r„,. (23) 



Then, choosing as in (|13D for ly. ^, = (^i) i/ie inclusion (jl6p /loMs 



The proof of Theorem [2] can be found in Appendix |B] 

We highlight that under Assumption [51 for a given i E A4, the quantities cti in ([T9)) . in 
(PT|) and f3i{5i) in ([221) depend only upon local fixed parameters {Aii,Bi,Ti,Hi}, neighbors' fixed 
parameters {Aij ,^j}j^j\f. (or equivalently {Aij,J-j}jizj\f.) and local tunable parameters {Ki,Si} 
but not on neighbors' tunable parameters. Moreover, also the computation of sets 1ji{Si) depends 
upon the same parameters. This implies that the choice of {Ki,Si} does not influence the choice 
of {Kj,Sj}j^i and therefore Problem P is decomposed in the following independent problems for 
i G M. 

Problem Pi 

Check if there exist Ki and 6i > such that ai < 1, Li > an /3j((5i) < 1. 
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Algorithm 1 Design of controller C[i] for system E^jj 
Input: Au, Bj, X^, U^, M, {AiJ}j(z^f,, {XjjjgA/-, 
Output: controller C[i] in ^ 

1) Find isTi and i5i > such that Assumption [T]-(lil) is fulfilled, < 1, (HU holds and l3i{Si) < 1. 
If they do not exist stop (the controller cannot be designed). 

2) Compute sets = 0jgAA. ^^'^ 

3) Compute Li as in (HI]), choose = and define as in pT|) . 

4) Compute ^i;,; as in (^5]) . set = and define Vi as in (fT^ . 

5) Compute ^/i(') a-nd X/^ verifying Assumption S) 

According to Theorem [2j the solution to Problem Vi enables the computation of sets X; and 
Vi and therefore the decentralized design of controller MPC-i. The overall procedure for the 
decentralized synthesis of local controllers C[j] , i G is summarized in Algorithm [TJ whose 
computational aspects are discussed in Section [S] 

In view of the previous discussion, the link between controllers designed through Algorithm [T] 
and Theorem [T] can be summarized as follows. 

Proposition 1. Under Assumptions\^ and\Si if for all i E M controllers C^^-^ are designed accord- 
ing to Algorithm{ll then all Assumptions of Theorem]^ are fulfilled. 

4 Plug-and-play operations 

In this Section we discuss the synthesis of new controllers and the redesign of existing ones when 
subsystems are added to or removed from system (|4]). The goal will be to preserve stability of 
the origin and constraint satisfaction for the new closed-loop system. Note that plugging in and 
unplugging of subsystems are here considered as off-line operations. Therefore, the overall plant 
is not modeled as a switching system. As a starting point, we consider a plant composed by 
subsystems i E M equipped with local controllers C[i], i G M produced by Algorithm [1] 

4.1 Plugging in operation 

We start considering the plugging of subsystem characterized by parameters Am+i 

Bm+i, Xj\/+i, Uj\f+i, 7Va/+i and {Aij} j^j^j^^^^, into an existing plant. In particular Nm+i iden- 
tifies the subsystems that will be physically coupled to and {Ajj}jg7v'j\j+i are the corre- 
sponding coupling terms. For building the controller C[j\/_(_i] we execute Algorithm [T] that needs 
information only from systems Sj^j, j G Mm+i- K Algorithm [T] stops before the last step we declare 
that cannot be plugged in. Let Si ~ {j : i £ J\fj} be the set of successors to system i. Since 
each system j G iSa/+i ha-s the new neighbor Sj^f+i], it can be happen that existing matrices 
Kj, j G Sm+1 now give aj > 1 or ij < or l3i(5i) > 1. Indeed, when A/} gets larger, the quantity 
aj in (|19p (respectively Lj in (|2ip ) can only increase (respectively decrease). Furthermore, the 
size of the set 'Zj{Sj) increases and therefore the condition in could be violated. This means 
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that for each j G Sm-^-i the controllers Cy] must be redesigned according to Algorithm [TJ Again, 
if Algorithm [T] stops before completion for some j G Sm+i, we declare that I][jv/+i] cannot be 
plugged in. 

In conclusion, the addition of system triggers the design of controller C[m+i] and the 

redesign of controllers Cy], j £ Sm+i according to Algorithm [1] Note that controller redesign 
does not propagate further in the network, i.e. even without changing controllers C[i] , i ^ 
{M + 1}1JiSa/+i stability of the origin and constraint satisfaction are guaranteed for the new 
closed-loop system. 



4.2 Unplugging operation 

We consider the unplugging of system ^[k], k E M. Since for each i E Sk the set JVi gets smaller, 
we have that in (respectively Li in (I^TI) ) cannot increase (respectively cannot decrease). 
Furthermore, the size of the set 'Zi{Si) cannot increase and therefore the inequality (j22p cannot 
be violated. This means that for each i € Sk the controller C[,;] docs not have to be redesigned. 
Moreover since for each system ^[j], j ^ {k}[JSk the set A/} docs not change, the redesign of 
controller Cy] is not required. 

In conclusion, removal of system Sj^.] docs not require the redesign of any controller, in order 
to guarantee stability of the origin and constraints satisfaction for the new closed-loop system. 
However we highlight that since systems i G Sk have one neighbor less, the redesign of 
controllers C[i] through Algorithm [T] could improve the performance. 



5 Practical design and computational aspects 
5.1 Automatic design of Ki and 6i 

The most difficult part of Algorithm[T]is stcp[T]and in this Section we propose an automatic method 
for computing the matrix Ki and Si > 0. We assume that Ki is the LQ controller associated to 
matrices Qi > and Ri > 0, i.e. 

K, = {R, + BJP,B,)-^BJP,Au (24) 
where Pi is the solution of the stationary Riccati equation 

+ Q^ - AlP,B,{R, + bJp,B,)-^bJp,Au = P^. 
We then solve the following nonlinear optimization problem 

min + MftA(<5i) (25a) 

Si, Q,, Ri 

Qt>0, R^>0 (25b) 

(5» > (25c) 

a» < 1, > (25d) 

P^{6^) < 1 (25e) 

where > and /i^. > 0. 

Feasibility of problem guarantees that Algorithm [1] does not stop and then the con- 
troller C[i] can be successfully designed. Moreover, in (j25ap weights and fip. establish a 
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trade-off between the maximization of sets and , respectively. A few remarks on tlie com- 
putations required for solving ([25|) are in order. First, beside the computation of Ki as in 
([M)) . problem (^5]) requires the computation of the set 'Zi{Si) that can be done using methods 
in |RKKM05] . simplified as follows. Under Assumption [21 Wi — (BjeN'i^ij'^j is a zonotope 
set defined as W; = {u'li] = 'Bwid^j,., Hd^Jloo < !}• Hence, using the procedure proposed in 
jRKKMOS] ■ the set 1^i{5i) is also a zonotope, defined as Zi{Si) = {z^q = E^.d^., Hd^. ||oo < 1}, 



where Sr 



with Si computed using Algorithm [T] in |RKKM05| . 
Since and TLi{bi) are zonotopes, using ([Ij, we can explicitly calculate the support function used 
in Algorithm [T] in jRKKM05| and rewrite as 

Second, we highlight that in absence of input constraints Ui, constraint (|25e[) (and hence the 
computation of RPI sets TLiibi)) is not necessary. Indeed if U; = R™% the inclusion ([T5)) holds 
for all sets Vi C R™'. Third, the series in (|19l) and (PH)) involve only positive terms and can 
be easily truncated either if (|25d|) is violated or if summands fall below the machine precision. 
Finally, in order to simplify problem (|25p one can assume Qi ~ diag((7i_i, . . . , gi.„J and Ri — 
diag(ri^i, . . . , hence replacing the matrix inequalities in (|25b[) with the scalar inequalities 

li.k > 0, fc G 1 : Tii and ri^fc > 0, fc G 1 : m^. 



5.2 Parameter-dependent subsystem 

In many engineering applications parameters of subsystem i are influenced by neighboring sub- 
systems. We model this scenario replacing ^ with 

Sf,] : a;+[,] = AdAii^ {6jbeM)2:[,] + Bi{i,,, {6j}jeM)ww + ^ (26) 

J" 6 A/; 

where G K^'^ are parameter vectors. 

We highlight that for a given sets A/i , i G , matrices An and i?i are constant and design of P&P 
DeMPC regulators can be still done using the methods described in Section [31 Furthermore, the 
procedure for plugging in a new system discussed in Scction r4.1l can be applied with no change since 
it requires the redesign of controllers C[j], j G Su+x-, i-C. controllers associated to the subsystems 
Sj^j for which matrices Ajj and Bj could change. However, when system Ej"^! gets unplugged, it 
is now mandatory to retune all controllers Cyj , j G Sk since changes of matrices Ajj and Bj could 
hamper the fulfillment of conditions (fTO)) . ([^T|) or (j22[) when using the matrices Kj and the scalars 
Sj computed prior to the subsystem removal. Moreover, if Algorithm [H stops before completing 
the redesign of controllers Cy], \/j G Sk, we declare that subsystem S?^, cannot be unplugged. 



6 Example: Power Network System 

In this Section, we apply the proposed DeMPC scheme to a power network system composed by 
several power generation areas coupled through tie-lines. We aim at designing the AGC layer with 
the goals of 

• keeping the frequency approximately at a nominal value; 
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• controlling the tie-line powers in order to reduce power exchanges between areas. In the 
asymptotic regime each area should compensate for local load steps and produce the required 
power. 

In particular we will show advantages brought about by P&P DeMPC when generation areas are 
connected/disconnected to/from an existing network. 

The dynamics of an area equipped with primary control and linearized around equilibrium 
value for all variables can be described by the following continuous-time LTI model |Saa02j 



xu 



AiiX\ 



(27) 



where = (Afl^, Auji, AP„ii, APy.) is the state, = AP^e/; is the control input of each area, 
APl is the local power load and Afi is the sets of neighboring areas, i.e. areas directly connected 
to through tie-lines. The matrices of system (|27p are defined as 










1 

Dj 
2 Hi 



1 





1 

]_ 









1 

Tt, 



B, = 























1 



1 






(28) 



For the meaning of constants as well as parameter values we defer the reader to Appendix [Cj We 
highlight that all parameter values are within the range of those used in Chapter 12 of [Saa02j . 
We note that model (P7)) is input decoupled since both AP^e/i and AP^^ act only on subsystem 
E . Moreover, subsystems S j^j are parameter dependent since the local dynamics depends on the 

quantities ^'^iw- — " ■ equip each subsystem E j^j with the constraints on A^^ and on AP^e/; 

specified in Appendix [Cl We obtain models by discretizing models Sj^j with 1 sec sampling 
time, using exact discretization and treating w^jj, AP^. , xjjj, j S Mi as exogenous signals. 
In the following we first design the AGC layer for a power network composed by four areas (Scenario 
1) and then we show how in presence of connection/disconnection of an area (Scenario 2 and 3, 
respectively) the AGC can be redesigned via plugging in and unplugging operations. 



6.1 Scenario 1 

We consider four areas interconnected as in Figure [TJ For each system E[i] we synthesize the 
controller A';, i £ Ai solving an LQ problem for the nominal system, as shown in Section [5. II with 
pLa- = 1 and /i^; = 1, Vi G Ai, and obtain the following matrices 



0.508 0.201 0.006 0.001 
3.409 4.759 0.090 0.030 



K2 



0.729 0.437 0.008 0.002 
4.426 6.348 0.233 0.038 



(29) 



that allow inequalities ([T^ to be fulfilled. Hence K verifies Assumption [T]-([ii|). Setting Si = 
10"'*, E M and applying steps 2-5 of Algorithm [TJ we can compute sets Zi{Si), and 
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Figure 1: Power network system of Scenario 1 



such that inclusions ((TS|) and hold, Vi G A^. Control variables u^^ are obtained through 
where iJ[j] = and = rii{x[j^) are computed at each time t solving the optimization 

problem (jl8p and replacing the cost function in (|18ap with the following one depending upon 
= (0, 0, APl,, APl,) and = APl, 



J. 



t+Ni~l 

E 

k=t 



(30) 



Note that, except for the above modification of the cost function, that is needed for counteracting 
load disturbances, we followed exactly the design procedure described in Section [2] Moreover, we 
highlight that each area can locally absorb the load steps specified in Table [3] of Appendix O This 
is also shown by convergence to zero of the power transfer between areas i and j given by 



APt, 



P,,{A9,-Ad,) 



(31) 



and represented in Figure [31 

In Figure[2]we compare the performance of proposed DeMPC with the performance of central- 
ized MFC. For centralized MFC we consider the overall system composed by the four areas, use 
the cost function X^ieA^ "^/^ impose the collective constraints ([5]). The prediction horizon is 
Ni = 20, i G AiioT MFC-i controllers and = 20 for centralized MFC. In the control experiment, 
step power loads AP^i specified in Appendix [C] have been used and they account for the step- like 
changes of the control variables in Figure [5J We highlight that the performance of decentralized 



and centralized MFC are totally comparable, in terms of frequency deviation (Figure 2(a) ), control 



variables (Figure 2(b) I and power transfers APuei^ (Figure [3]). 



6.2 Scenario 2 

We consider the power network proposed in Scenario 1 and we add a fifth area connected as in 
Figure |3] with values of parameters and constraints listed in Table [2] of Appendix [Cj Therefore, 
the set of successors to system 5 is ^Ss = {2, 4}. 

As described in Section l4Tl only systems j £ 1S5 update their controller C[j]. For systems 
j G iSs, since the set A/} changes, we retune controllers C[j] using Algorithm [T] In particular, 
we compute Kj , j G S5 and using the procedure described in Section 15.11 with /^q,^ ~ 1 and 
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(a) Frequency deviation in each area controlled by the proposed De- 
MPC (bold line) and centralized MFC (dashed line). 
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(b) Load reference set-point in each area controlled by the proposed 
De-MFC (bold line) and centralized MFC (dashed line). 



Figure 2: Simulation Scenario 1: 2(a) Frequency deviation and 2(b) Load reference in each area. 



fipi_ = 1, fc G {5} 1J55 and obtain 

K2 = - 0.659 1.275 0.028 0.007 
K5 = - [o.l23 0.158 0.007 0.001 



0.713 1.105 0.048 0.008 



(32) 



that allow inequalities to be verified for systems ^[j], j G S5 and £[5]. Therefore K fulfills 
Assumption [T]- (in]). Setting 6j = 10^"*, j G S5 and — 10^'^, the execution of Algorithm [1] does 
not stop before completion and hence we compute the new sets Z,j{Sj), Xj and V_,, j G {5}lJiS5. 
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DeMPC (bold line) and centralized MPC (dashed line). 
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Figure 4: Power network system of Scenario 2 



We highlight that no retuning of controllers C[i] and C[3] is needed since systems Sjij and I][3] are 
not neighbors to system S[5]. 

In Figure[5]we compare the performance of proposed DeMPC with the performance of central- 
ized MPC. For centralized MPC we consider the overall system composed by the four areas, use 
the cost function X^jgAi '^i' ^^"^ impose the collective constraints (|S]). The prediction horizon is 
Ni = 20, i G for MPC-i controllers and iV = 20 for centralized MPC. In the control experiment, 
step power loads AP^ . specified in Appendix [C] have been used and they account for the step-like 
changes of the control variables in Figure [5j We highlight that the performance of decentralized 



and centralized MPC are totally comparable, in terms of frequency deviation (Figure 5(a) ), control 
variables (Figure [5(b)] ) and power transfers APtie. . (Figure [5]). 
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(a) Frequency deviation in each area controlled by the proposed De-MPC (bold line) and centralized MPC 
(dashed line). 
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(b) Load reference set-point in each area controlled by the proposed De-MPC (bold line) and centralized 
MPC (dashed line). 



Figure 5: Simulation Scenario 2: 5(a) Frequency deviation and 5(b) Load reference in each area. 



6.3 Scenario 3 

We consider the power network described in Scenario 2 and disconnect the area 4, hence obtaining 
the areas connected as in Figure [71 The set of successors to system 4 is .$4 = {3,5}. Because of 
disconnection, systems E^j, j G ^4 change their neighbors and local dynamics Ajj. Moreover, it is 
possible to verify that matrices Kj computed in Scenario 2 do not solve Problem Vj, j G S4. Then 
as described in Section 15.21 each subsystem S^j, j e ^4 must rctune controller Cy] by running 
Algorithm [TJ In particular, we compute K3 and A's using the procedure proposed in Section [5.11 
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Figure 6: Simulation Scenario 2: tie- line power between each area controlled by the proposed 
DeMPC (bold line) and centralized MPC (dashed line). 



L,2 



AR 



re/,2- 



^[2] 



APl,3 

— -Au!2 APre/,3 • 

< 7^ ► 



12 



AP 



P 



^[3] 



AP, 



23 



L,5 



AP 



re/,5 ■ 



P 



15] 



■Aui5 



25 



AP^e/,1- 



11] 



■Acji 



Figure 7: Power network system of Scenario 3 



with — 1 and /i^^ = 1, j G 54 and obtain 



4.766 5.954 0.110 0.036 



4.102 4.861 0.201 0.038 



(33) 



that allows one to verify inequalities (|T9|) for systems ^y], j G ^4. Therefore K is such that 
Assumption [T]-([u|) holds. Setting Sj = 10^"*, j £ 54, the execution of Algorithm [T] does not stop 
before completion and hence we compute the new sets ^^{Sj), and Yj, j G S4. We highlight 
that retuning of controllers C[i] and C[2] is not needed since systems E[i] and S[2] are not neighbors 
to system I][4]. 



In Figure [5] we compare the performance of proposed DeMPC with the performance of cen- 
tralized MPC. For centralized MPC we consider the overall system composed by the four areas, 
use the cost function J2i£M '^i' ^"^^ impose the collective constraints (|H]). The prediction horizon 
is Ni = i G M for MPC-i controllers and = 20 for centralized MPC. In the control ex- 
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(a) Frequency deviation in each area controlled by the proposed 
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Figure 8: Simulation Scenario 3: 8(a) Frequency deviation and |8(b)]Load reference in each area. 



pcriment, step power loads AP^. specified in Appendix [Cl have been used also in this case. We 
highlight that the performance of decentralized and centralized MFC are totally comparable in 
terms of frequency deviation (Figure 8(a)), control variables (Figure [8(b)] ) and power transfers 
APue,^ (Figured). 
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Figure 9: Simulation Scenario 3: tie-line power between each area controlled by the proposed 
DeMPC (bold line) and centralized MPC (dashed line). 



7 Conclusions 

In this paper we proposed a tube-based DeMPC scheme for linear constrained systems, with the 
goal of stabilizing the origin of the closed-loop system and guaranteeing constraints satisfaction. 
The key feature of our approach is that the design procedure does not require any centralized 
computation. This enables P&P operations, i.e. when a subsystem is plugged-in or unplugged at 
most the synthesis of its controller and the redesign of successors' controllers are needed. In future 
we will generalize our approach to embrace decentralized output-feedback control and tracking 
problems. 
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A Proof of Theorem [T] 



The proof uses arguments similar to the ones adopted in |FS12| for proving Theorem 1. 

We first show recursive feasibility, i.e. that X[i]{t) E Xf, Vi G A4 implies X[.i]{t + 1) G Xf^. 

Assume that, at istant t, X[i] (t) G X^. The optimal nominal input and state sequences obtained 
by solving each MPC-z problem Pf are V[^{0 : Ni - l\t) = {v[^{0\t), . . . ,V[,]{N, - l\t)} and 
X[,](0 : N,\t) = {x[,](0|t),...,X[,](iV,;|t)}, respectively. Define wf,f (iV,|<) = <--(i[,](7V,|0) and 
compute x'^^'={N, + l\t) according to (fT8c| from X[^{N,\t) and V[q{N,\t) ^ w[jp(iVi|t). Note 
that, in view of constraint (jlSfp and points (jn]) and (pU)) of Assumption 21 v^^^{Ni\t) G Vi and 
x'^^^{Ni + l\t) G Xy. C X;. We also define the input sequence 

: N,\t) = {v[^{l\t),...,V[,]{N, - l\t) , v^^^^ {N,\t)} (34) 

and the state sequence produced by (|18cp from the initial condition xjjj (0|t) and the input sequence 
V[^{1 : Ni\t), i.e. 

i[,](l :N, + l\t+l) = {i[,](l|t), . . . , £[,](Ar,|0,xf|^(iV, + l|t)}. (35) 

In view of the constraints (|T5)) at time t and recalling that Zi{Si) is an RPI for ^TS\i and W[i:^ G 
= ®jeA/'i ^ij^ii '^^ have that a;[i](t + 1) — X[i](l|i) G Zi{Si). Therefore, we can conclude that 

the state and the input sequences X[i]{l : Ni + l\t) and W[i](l : Ni\t) are feasible at t + 1, since 

constraints (jl8bp - (jl8f|) are satisfied. This proves recursive feasibility. 
We now prove convergence of the optimal cost function. 

We define Pf '°(.T[j] (0|t)) = niin„|^j(o:Ar,_i|t) X^fclo^ ^i(^w(^)''"w('=)) + K/. (^[i] (^0) subject to 
the constraints (|18cp - (jl8f|) . By optimality, using the feasible control law ([M)) and the corresponding 
state sequence (pSj) one has 

Pf'°(i[,](l|t)) <Y.e^{x[,]{k\t),v^,]{k\t)) + VfAx^fiN, + l\t + l)) (36) 
fc=l 

where it has been set V[i^{Ni\t) = v^^^{Ni\t). Therefore we have 

PP(£[,](l|i)) - pf °(£-[,](0|i)) <- £,(£•[,] (0|i),z;[,](0|t)) + £,(£[,] (iV,|t),«fjp(Ar,|t))+ 

In view of Assumption HI (jrv)) . from (j37p we obtain 

Pf-"(£[,](l|0)-Pf-°(x[,](t)) < -£.(iwW,«wW) (38) 

and therefore i[i](0|t) and V[i]{0\t) — > as t — oo. 

Next we prove convergence to zero of state trajectories x(i) of the closed-loop system with 
x(0) G X^. 

Recall that the state x(i) evolves according to the equation ([7]). By asymptotic convergence to 
zero of the nominal state and input signals i:[j](0|<) and W[i](0|t) respectively, using the diagonal 
structure of B and K, we obtain that B(v(0|i) — Kx(0|t)) is an asymptotically vanishing term. 
Under Assumption [T]-([u|), A + BK is Schur, hence we obtain x(t) as t — > cx). 

We prove now stability of the origin of the closed-loop system therefore completing the proof 
of statement (ii). We first show that 

x(0) G Z =^ x(t) G Z and x(t + 1) = (A + BK)x(t), > (39) 
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where Z = J^jg^ T,i{5i). Formula (j39p is an easy consequence of Proposition 2 in jMSROS] that 
we detail in the following for the sake of completeness. 

If x(0) S Z then, as shown in |MSR05j . v = and x = 0. Therefore from ([7]) we have 

x+(l) = (A + BK)x(0) 

Furthermore, since sets are RPI for (fT?)l . one has that Z is positively invariant for 

x+ = (A + BK)x (40) 

that coincides with ([T^ after renaming veriables as Therefore x(t) G Z for i = 1 and, 
applying the previous argument recursively for < > 1, we have shown that (j39p holds. 
Now, we focus on stability. Given e > 0, choose 77 e (0, 1) such that 

r;Z C 5,(0). (41) 

Such an 77 always exists because Z is bounded and includes the origin in its interior. More precisely, 
boundedness of Z follows from Z C X and the boundedness of X, that is guaranteed by Assumption 
[2l Furthermore, the mRPI for HH) is given by |RM09] 

00 

and therefore it includes the origin in its interior. It follows that the same is true for sets Zi((5i), 
i & M and Z = OiGAi ^«('^*)- Since the origin is strictly contained in Z, there always exists 
^ > such that BsijS) C 7^Z. Since -85(0) C Z one has that, in view of ([5^ . the state trajectory 
x(<), t > {) stemming from x(0) G i?5_(0) fulfill the dynamics (^(1)) . Furthermore, since (PU]) is a 
linear system for which Z is positively invariant set, one has that also 77Z is positively invariant. 
Then, we have shown that 

x(0) G %(0) ^ x(t) G 7?Z, > 0. 
From (|^T|) stability of the origin follows. 



B Proof of Theorem [2] 
B.l Proof of (I) 

Define a matrix M such that its ij-ih entry /iij is 

= -1 if * = J 

Note that all the off-diagonal entries of matrix M are non- negative, i.e., it is Metzler |FR00| . We 
recall the following results. 

Lemma 1 (see |MS07| '). Let matrix M G M*^^*^ be Metzler. Then M is Hurwitz if and only if 
there is a vector v G such that Mi^ < 0. 

Lemma 2. Define the matrix F = M + \m where M G M}^^'^^ , 1m is the M x M identity matrix 
and V is non negative. Then the Metzler matrix M is Hurwitz if and only if V is Schur. 
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The proof of Lemma [2] easily follows from Theorem 13 in jFROOj . 
Inequalities (fT9|) are equivalent to M.iy < 0^/ where v = 1m- Then, from Lemma [TJ M is Hurwitz. 
From Lemma [21 (HH) implies that matrix F = M + Im is Schur. 

For system S^jj in (jH)-®, when u^^ is defined as in (jS]), = and x^^ — 0, we have 

t-i 

x^^ (t) = F^x^^ (0) + Y.FtY^ A.,,xy] {t^k-1) (42) 

k=0 j£j\fi 



In view of (1421) we can write 



\\F^X^,]{t)\\oo < \\F^Fl^^\\^\\T^X^^{0)\\^ + 

+ 7ijmax||J"ja;[j](fc)||oo. 

where "fij are the entries of F. Denoting X[i] ~ TiX^i], we can collectively define x = Fx, where 
F = dia.g{Fi, . . . , Fm)- From the definition of sets X^, we have rank(J^) = n. We define the 
system 

i+ = (A + BK)i (43) 

where A = FAF^ , B = and K — K-F^ . In order to analyze the stability of the origin of (021) j 
we consider the method proposed in |DRW07j . In view of Corollary 16 in |DRW07j . the overall 
system (|43p is asymptotically stable if the gain matrix F is Schur. As shown above this property 
is implied by (fTOl) . 

Moreover, system (|^51) is an expansion of the original system (see Chapter 3.4 in [Lun92j ). In view 
of the inclusion principle (see Theorem 3.3 in |Lun92| and |Sta04| for a discrete-time version), the 
asymptotic stability of (|43l) implies the asymptotic stability of the original system. 

B.2 Proof of (II) 

First note that, for i G Ad, in view of (fTUl) ||/,f",.Si||oo = 1 for all ?■ G 1 : fi and therefore ||J^iSi||oo ~ 
1. This implies that Wf^^F^ A,,^,W^ < \\f^^F^' A,,F'^\U\F,E,\\^ = Wfl^rFtAjF'^Woo < 



Therefore, in view of p9|l . for all r G 1 : 

oo oo 

E E WkrFtAj^.Woo < E E mF^A^jF^Woo < 1 (44) 

Now we want to find parameter li > such that, simultaneously, the inclusion (|15p holds and 
Zi{5i) is a outer approximation of the mRPI Zj. The mRPI for (|14p is given by [RKKMOS] 

oo 

^«=0^'0^^.X.- (45) 

k=0 jeAfi 

From jRKKM05| . for given Si > there exist a; G M and Si e N+ such that the set 

Si-l 

ZM) - (1 - AyX, (46) 

k=o jeMi 
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is a outer approximation of the mRPI Zj. 

Define = X,; © 'Zi{Si). Following the proof of Proposition 2 in jFS12| and using arguments from 
Section 3 of [KG98| , we can then guarantee ((TS|) if X^ C X^ , which holds if, for all r S 1 : fi 

sup f^^{z[n+ X[,]) <1. (47) 

2[i]6Zi(5i) 

Using (12) and (|i5|) . the inequalities (|T7l) are verified if 

sup^ /if,.({a:[,](fc)}-e^--°°,iw) + ll/S^^.lloo < 1 (48) 

o-,e-B5i(o) 

where /if ,,(•) flriJ2T=o P^ T^jaM, ^^3^ i^) + ^^w)- 
Since ||/j^r^j||oo < | |/i^rl loof^i, conditions (|48|) are satisfied if 

sup^ ^ KA{x[,}{k)})f^-:-'^,X[^) < 1 - ||/i^||oo<5.. (49) 

Using (fTO)) and (jlip wc can rewrite (|49)) as 

sup hU{d,{k)}'-;^:--'°^,d,)<l-\\fl.\\^S. (50) 
{||d,(fe)||^,<i}^"jX^. 

|d!||=o<ii 

where h^J-) = f^^AEZo E,gM ^^i^jd^k) + %d,)- 
The inequalities ([501) are satisfied if 

CXD 

E E ii/i!;^'^.jS,iioo + ii/:s-^.iu/; < 1 - (51) 

fe=o jeTVi 

for all r 6 1 : fi. 

In view of (|44)) there exist sufficiently small (5^ > and > satisfying ((5T|) (and therefore 
verifying (fTS)) ). e.g. choosing £ (0, L^]. 

B.3 Proof of (III) 

For each i G A^, we want to find tightened input constraint Vi such that (fTB)) holds. Following 
the rational used in Section 3 of jKG98j . from definition of sets Ui and V^, (|T6)) holds if ((22)) is 
satisfied. Hence, choosing Vi as in for = Ivi.ri^i) the inclusion ([TB)) holds. 



C Parameters, constraints and setpoints of experiment de- 
scribed in Section [6] 
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Deviation of the angular displacement of the rotor with respect to the stationary reference axis on the stator 
Speed deviation of rotating mass from nominal value 
Deviation of the mechanical power from nominal value (p-u.) 
Deviation of the steam valve position from nominal value (p.u.) 
Deviation of the reference set power from nominal value (p.u.) 
Deviation of the nonfrequcncy-scnsitivc load change from nominal value (p.u.) 

T ,. i i J c J jT kinetic energy at rated speed /, ■ n , ■ n im \ 

Inertia constant defanod as Hi = fi^ t-- (typically values m range 1 — 10 sec) 

machine rating w t- j o i \ i 

Speed regulation 
n , percent change in load 
change in frequency 
Prime mover time constant (typically values in range [0.2 — 2] sec ) 
Governor time constant (typically values in range [0.1 — 0.6] sec ) 
Slope of the power angle curve at the initial operating angle between area i and area j 



Table 1: Variables of a generation area with typical value ranges |Saa02| . (p.u.) stands for "per 
unit" . 





Area 1 


Area 2 


Area 3 


Area 4 


Area 5 




12 


10 


8 


8 


10 




0.05 


0.0625 


0.08 


0.08 


0.05 




0.7 


0.9 


0.9 


0.7 


0.86 


Tu 


0.65 


0.4 


0.3 


0.6 


0.8 




0.1 


0.1 


0.1 


0.1 


0.15 





Area 1 


Area 2 


Area 3 


Area 4 


Area 5 


Ad, 


||a;[ia]IU < 0.1 


||a;[24]||oo < 0.1 


lk[3,lllloo < 0.1 


||a;[44]||co < 0.1 


lk[5a]l|oo < 0.1 


APreU 


|m[i]||oo < 0.5 


IK2]l|oo <0.65 


llwisjilcxj < 0.65 


||M[4]||oo <0.55 


||W[5]||oo < 0.5 



Pl2=4 P23 = 2 P34 = 2 P45=3 P25 = 3 



Table 2: JVIodel parameters and constraints for systems i G 1 : 5. 



Step time 


Area i 




5 


1 


+0.15 


15 


2 


-0.15 


20 


3 


+0.12 


40 


3 


-0.12 


40 


4 


+0.28 



Table 3: Load of power APi^ (p-U-) for simulation in Scenario 1. +APi; means a step of required 
power, hence a decrease of the frequency deviation Aw^ and then an increase of the power reference 
AP,.e/i, while — APi- means the opposite. 
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Step time 


Area i 




5 


1 


+0.10 


15 


2 


-0.17 


20 


1 


+0.05 


20 


2 


+0.12 


20 


3 


-0.10 


30 


3 


+0.10 


40 


4 


+0.08 


40 


5 


-0.15 



Table 4: Load of power A.Pl. (p-u.) for simulation in Scenario 2. +APl. means a step of required 
power, hence a decrease of the frequency deviation Aw^ and then an increase of the power reference 
APrefi, while — AP^. means the opposite. 



Step time 


Area i 




5 


1 


+0.12 


15 


2 


-0.15 


20 


5 


+0.20 


40 


2 


+0.15 


40 


3 


+0.13 


40 


5 


-0.20 



Table 5; Load of power AP^. (p-U-) for simulation in Scenario 3. +APl. means a step of required 
power, hence a decrease of the frequency deviation Aw^ and then an increase of the power reference 
APre/i, while —APl- means the opposite. 
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